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Abstract 

A length-n random sequence Xi,, Xn in a space S is finitely exchangeable if 
its distribution is invariant under all n! permutations of coordinates. Given N > n, 
we study the extendibility problem: when is it the case that there is a length-A ex¬ 
changeable random sequence Yi,..., Yjv so that (Yi,..., Y„) has the same distribution 
as (Ai,..., A„)? In this paper, we give a necessary and sufficient condition so that, for 
given n and N, the extendibility problem admits a solution. This is done by employing 
functional-analytic and measure-theoretic arguments that take into account the symme¬ 
try. We also address the problem of infinite extendibility. Our results are valid when 
Xi has a regular distribution in a locally compact Hausdorff space S. We also revisit 
the problem of representation of the distribution of a finitely exchangeable sequence. 
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1 INTRODUCTION AND MOTIVATION 

Exchangeability is one of the most important topics in probability theory with a wide range 
of applications. Most of the literature is concerned with exchangeability for an infinite 
sequence X = {Xi,X 2 ,...) of random variables, taking values in some common space S, in 
the sense that the distribution of the sequence does not change when we permute finitely 
many of the variables. David Aldous’ survey [I] of the topic gives a very good overview. The 
basic theorem in the area is de Finetti’s theorem stating that, under suitable assumptions 
on S, an exchangeable sequence is a mixture of i.i.d. random variables [7, 15, 18, 22]; that 
is, there is a probability measure p on the space of probability measures on S such 

that 

F{X€-)=[ 7r-(.)p(dvr), (1) 
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and, moreover, the so-called mixing measure is nnique. The most usnal condition on S is 
that it be a Borel space (a measure space that is measure-isomorphic to a Borel subset of 
the real line). In this case, the regular conditional distribution t] of Xi given the invariant 
(T-algebra of {Xi,X 2 , ■ ■.) exists, and the mixing measure fj, is simply the law of the random 
measure rj. The idea of this is due to Ryll-Nardzewski [28] and a modern proof of it can be 
found in Kallenberg [22], Another condition on S is that it be a locally compact Hausdorff 
space equipped with the cr-algebra of Baire sets; see Hewitt and Savage [18]. However, (1) 
fails for a general space S'; see Dubins and Freedman [13] for a classical counterexample. 

Throughout the paper, when (S, is a measurable space, is equipped with the 
product fj-algebra and S^, the set of sequences in S, is equipped with the a-algebra 
generated by cylinder sets. Also, the set ^(S) of probability measures on (S, is 
equipped with the smallest a-algebra that makes the functions 9 tt >-)■ 7r{B) G M, 

where B ranges over =5^, measurable. 

Our paper is concerned with finitely exchangeable sequences {Xi,..., Xn) of a fairly 
general space S. We say that {Xi,... ,Xn) is n-exchangeable, or, simply, exchangeable, if 
its law is invariant under any of the n! permutations of the variables. Finitely exchangeable 
sequences appear naturally in biology models e.g., in the exchangeable external branch 
lengths in coalescent processes [9, 34, 10, 19, 5], as well as in statistical physics models [25]. 

The following issues are well-known. First, finitely exchangeable sequences need not be 
mixtures of i.i.d. random variables. Second, finitely exchangeable sequences of length n may 
not be extendible to longer (finite or infinite) exchangeable sequences. 

Regarding the first issue, there is the following, at first surprising, result: 

Theorem 1.1 (finite exchangeability representation result). Let {S,S^) he an arbitrary 
measurable spaee and let (Ai, ..., A„) be an n-exchangeable random element of (5”,.5^"'). 
Then there is a signed measure u, with finite total variation, on the spaee of probability 

measures on S, sueh that 

P((Ai,...,A„) G A) = / 7r"(A)i/(d7r), VA G (2) 

J3»{S) 

This result was first proved by Jaynes [21] for the case where 5" is a 2-element set. See 
also the paper of Diaconis [11] for a clear discussion of the geometry behind this formula. 
The general case, i.e., for arbitrary measurable space {S,dX), was considered by Kerns and 
Szekely [24]. In [20] we gave a short, complete, and general proof of the formula (also 
clarifying/correcting some subtle points of [24]) and established some notation which is also 
used in this current paper. We express the above result by saying that the law of an n- 
exchangeable random vector is a (signed) mixture of product measures. Moreover, u is not 
necessarily unique and, typically, it is not. The signed measure v is referred to as a directing 
signed measure. By “signed” we of course mean “not necessarily nonnegative”. 

Consider now the second issue, that of extendibility. Let (5, be a measurable space 
and (Ai,..., A„) an n-exchangeable sequence of random elements of S. 

(a) Finite extendibility. For integer N > n, we say that (Ai,...,A„) is A-extendible 
if there is an A-exchangeable sequence (Yi,...,YAr) of random elements of S such that 

(Ai,..., Xn) *■= (Li,..., Yn), where denotes equality in distribution. 

(b) Infinite extendibility. We say that (Ai,...,A„) is infinitely-extendible, if there is an 

infinite sequence (Yi, Y 2 ,...) that is exchangeable and (Ai,..., A„) (Yi,..., Y„). 
Alternatively, we say that an exchangeable probability measure Pn on S'”, invariant under all 
n! coordinate permutations, is A-extendible if there is an exchangeable probability measure 
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Pn on such that Pn{A) = Pn{A x for all A G Similarly for infinite 

extendibility. 

It is not difficult to see that a finitely exchangeable sequence may not be extendible. For 
instance, let Pn be the probability measure corresponding to sampling without replacement 
from an urn with re > 2 different items. Specifically, let S = {0,1} and Pn the uniform 
probability measure on the set (xi ,... ,Xn) G such that the number of x* that are equal 
to 1 is fixed and equal to k, say. (The value of Pn at a single (xi,... ,x„) equals l/(^).) 
Then it is easy to see that there is no > re for which Pn is A^-extendible. 

One of the goals of this paper is to give necessary and sufficient conditions for N- 
extendibility. A trivial case is that of mixture of product measures, i.e., if Pn{A) = 
f^(S) '^’^(A) i^idvr) for some probability measure v on then, clearly, Pn is A^-extendible. 

But this case is far from being necessary. 

The extendibility problem has attracted some attention in the literature. For a finite set 
S the finite extendibility problem reduces to the problem of determining whether a point is 
located in a convex set in a multidimensional real vector space. This geometric point of view 
was initiated by de Finetti [8] and further pursued by Crisma [3, 4], Spizzichino [31], and 
Wood [33]. The complexity of the problem increases when S is an infinite set. In this case, 
there is no general method characterizing finite extendibility. An important contribution is 
made by Diaconis [11] and Diaconis and Freedman [12] provided hnite extendibility. They 
show that, given a certain hnite extendibility, one may bound the total variation distance 
between the given exchangeable sequence and the closest (true) mixture of i.i.d. random 
variables (and this provides another proof of de Finetti’s theorem.) 

Regarding inhnite extendibility, de Finetti [6] gives a condition for the binary case ([S'! = 
2) using characteristic functions. When S' is a general measurable space, no criteria for 
hnite or inhnite extendibility exist. For either problem, only necessary conditions exist; see, 
e.g., Scarsini [29], von Plato [32], and Scarsini and Verdicchio [30]. For the case S = M and 
when variances exist, one simple necessary (but far from sufficient) condition for inhnite 
extendibility is that any pair of variables have nonnegative covariance ([24, page 591]). This 
is certainly not sufficient (see §A.l for a simple counterexample). As far as we know, the 
extendibility problem has been dealt with on a case-by-case basis. For example, Gnedin 
[17] considers densities on M”' that are functions of minima and/or maxima, and Liggett, 
Steif and Toth [25] solve a particular problem of inhnite extendibility within the context of 
statistical mechanical systems. 

In this paper, we provide a necessary and sufficient condition for the extendibility prob¬ 
lem. First of all, we do not restrict ourselves to the hnite S case. One of our concerns is to 
work with as general S as possible. There are topological restrictions to be imposed on S, 
arising from the methods of our proofs. We dehne certain linear operators via symmetrizing 
functionals on hnite products of S and use functional analysis techniques to give a necessary 
and sufficient condition for extendibility. 

We use the term “primitive Wextending functional” for the most basic of these operators 
(see Section 3.2), denote it by Sn , and construct it as follows. Let —>■ M be bounded 

and measurable. For N > n, dehne g : —)■ ffi to be a symmetric function obtained by 

selecting re of the N variables xi,..., xn at random without replacement and by evaluating 
g at this selection: 
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where 

6[n, A^] := the set of all injections from , n} into N} 

and 

{N)n := N{N -!)■■■ {N -n + 1) = |6[n,lV]| 

is the cardinality of this set. When N = n, the set G[N] := ©[A^, A^] is the set of all 
permutations of {1,... , A^}. Now define the linear functional 

whenever the function gf : S'” ^ M is bounded and measurable. At first sight, this might 
not even be a function; but it turns out to be, and this is shown in Section 3, Lemma 3.3, 
a statement that depends on the properties of urn measures developed in Section 2. Let 
(Ai,..., Xn) be an exchangeable random element of S”. Define 


1|S,^|| ;= sup ^ |Eg'(Ai,... ,Xn)\ : g bounded measurable, \U^g{x)\ < 1 for all x € S 


N. 


:<N 


Then our first result can be formulated as follows. 


Theorem 1.2. Suppose that S is a locally compact Hausdorff space and dX its Borel a- 
algebra. Let X = (Ai,..., A„) be an exchangeable random element of such that the law 
of Xi is outer regular and tight. Let N be a positive integer, N >n. Then (Ai,..., A„) is 
N-extendible if and only if ||S^|| = 1. 

The problem of infinite extendibility is addressed next. That is, given an n-exchangeable 
probability measure that is A-extendible for all A > n, is it true that it is infinitely- 
extendible? The answer to this may seem “obviously yes” and it is so if 5 is a Polish space. 
In the absence of metrizability, we work with quotient spaces in order to give an affirmative 
answer to this question: see Theorem 4.1 in Section 4. 

The paper is organized as follows. Section 2 develops some notation and results related 
to urn measures. The main result of this section, Lemma 2.1, is responsible for the fact 
that 8^ is well-defined and could be of independent interest. In Section 3 we relate sym- 
metrization operations to urn measures and are naturally led to the construction of 8^ and 
its extensions that we call extending functionals. These are functionals that extend 8^ 
on the space b{S^) of bounded measurable functions / ; —>■ M and are symmetric in 

the sense that their action on / does not depend on the order of arguments of /. Their 
existence is guaranteed by the Hahn-Banach theorem. We then develop several properties 
of symmetrization operations and extending functionals (Lemmas 3.1-3.6). Lemma 3.6, in 
particular, provides the necessity part of Theorem 1.2 and requires no assumptions on S. 
The results of §§3.1, 3.2, 3.3 require no assumptions on S neither. With the view towards 
establishing the sufficiency part of Theorem 1.2 we assume that S' is a locally compact 
Hausdorff space in §3.4 and prove the sufficiency part in this section. Section 4 deals with 
infinite exchangeability, under the same assumptions on S. Section 5 gives a condition under 
which the signed measure n in the representation formula 2 is a probability measure. In 
Section 6 we give a different version of the main theorem and some results on persistence of 
extendibility property under limits. 
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2 URN MEASURES 


Let S' be a set and N a positive integer. A point measure u is any measure of the form 
i' = for Ci nonnegative integers and a* G S, where da{B) is 1 ii a ^ B, and 0 

if a ^ R, for B C S. We let ^{S) be the collection of all point measures. We let jVn{S) 
be the set of all v G M^(S) with total mass N. Point measures are defined on all subsets 
of S. We write i^{a} for the value of i' at the set {a} containing the single point a G S. 
If are two point measures, we write fj, < ly whenever //(R) < z^(R) for all R C S. If 

X = {xi,... ,xj\f) G we define its type to be the point measure 



2 = 1 


For u G M^(S), let 

S^(i/) :: 

This is a finite set whose cardinality is 
by 

/N 


= {x £ : Ex = v}. 

denoted by (^) and which is easily seen to be given 
\ iV! 


OaG^Ka}!' 

The product in the denominator involves only finitely many terms different from 1. Let 


un,v ■= the uniform probability measure on (u). 


Let now n < N he a, positive integer, consider the projection 


vr^ : (xi,..., x„,..., xn) {xi, ..., x„). 


and let 

:= image of un,^ under vr^. 

Clearly, ^ = un,u- ^ The support of is the (finite) set of all (xi,...,x„) G 5” 
such that (fxi + • • • + Sxn < If {xi, ■ ■ ■ ,xn) G and (xi,... ,x„) G where 

jj < u, we can easily compute the value of at the set containing the single point 
(oi, ..., ttn) G S"'{p) as follows: 

• • • I «n)} = UN,u{ixi ,..., xn) G S^{u) : xi = ai,... ,Xn = an} 

— aN,v{{a \, . . . , On, Xn-\-l i • • • Xn) G S . T ■ ■ ■ T ^ t^} 

_ \s^-^{u-y,)\ _ (^r;) 

o ■ 


But is the uniform probability measure on S'"'(/i); so ..., a^)} = l/(”), and 

so the above can be written as 


^n,v 'y y /^) (^) 

^The measure is called urn measure because of its probabilistic interpretation: think of the elements 
of the support of v as colors and consider an urn containing N balls such that there are i^fa} balls with color 
a; make n draws without replacement; then Un,v is the probability distribution of the colors drawn. 


5 






where 


with the understanding that a{v, /i) = 0 if it is not the case that ^ < v. Simple algebra then 
shows that 

^ ^n{S), e ^n{S), n < V. (5) 

\n) 

The binomial symbols in (5) are now standard ones: ('^) = N\/n\{N — n)l. We now pass 
on to the following algebraic fact stating that for any /r G ,An{S), and any N > n, we can 
express as a linear combination of finitely many urn measures 

Lemma 2.1. Fix n,N be positive integers, n < N and fj, G yi<n{S). Then there exist 
c{pL, i^) G M, G ^n{S), such that c{ix, u) is zero for all hut finitely many v and 

<,M= X] (6) 

y^jy^N{S) 

Moreover there exists K > 0 (depending on n and N) such that 

sup „ E \c{iJ,,n)\<K. (7) 

Proof. Let p. G Mn{S) and let be its support. Let k be the cardinality of T^. Write 
Tfj, = {ai,..., Ofc} and order it in an arbitrary way, say: 

Ol < • • • < Ofc. 

This order induces an order on Mn{T^), the set of point measures of mass n supported on 
T^: for Ai,A 2 G ^(T^), we write 

Ai ^ A 2 

if (Ai{ai},..., Ai{afc}) is lexicographically smaller than (A 2 {ai}, • • •, A 2 {ofc}), that is, 

3 1 < j < fc such that Ai{ai} = A 2 {aj}, 1 < i < j — 1 and Ai{aj} < A 2 {aj}. 

This is a total order. For A G PKiiTffij, let G be defined by 

= X + ^N -n)6a,. 

By (3), 

<A-= E Ag^„(T^). 

Observe that the square matrix [a(A'^, «:)]A,KG.y^(r^) has a lower triangular structure with 
respect to the lexicographic order, 

a(A^, k) = 0 if A ^ K, 


while 

a(A^,A) > 0. 


These follow from (5) and the definitions above. Therefore the square matrix is invertible 
and the claim follows. From the above construction, {c(/r, depends only on the 

cardinality of the support of p and mass on each atom in the support. So (7) follows. □ 
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3 SYMMETRIZING OPERATIONS AND EXTENDING EUNGTIONALS 


3.1 Symmetrization of a function. We say that a function g{xi ,..., Xk) is symmet¬ 
ric if it is invariant under all kl permutations of its arguments. From a real-valued function 
g{xi,... ,Xn) on we produce a symmetric function, denoted by U^g, on , by: 


Un g{xi,...,XN) 


fjVl ^ 9{Xa{l)T ■ ■ 
^ crG0[n,A^] 


( 8 ) 


and view as a linear operator from the space of (bounded measurable) functions on 
into the space of (bounded measurable) symmetric functions on . To link it to urn 
measures, let be the probability measure on obtained by making n ordered selections 
without replacement from an urn containing N balls labelled xi,... ,xi\f, at random: 


: = 


iN)r 


E 

aGG[n,N] 


r(l) v)^<T(n) ' 


Thus, is an exchangeable probability measure on for all x G . Clearly, 


N 


1 X I g ^^n,x 5 X (^X\^ ^ X G S 

Js^ 


But we observe that 


,N 


Lemma 3.1. is the same as . 

Proof. To see this, use (3) and (5) to write 

n„Es(±!) 1 


= 


E i.iafc.5 V/i{a}/ r ^ 

jn\ tw 2^ 

kL&jK,{S) y-n) 

(iv), 




y&S^iP) 


Z^ Z^ - = 


y&S^ 


iN)r 




yeS^ 


{N)r 


On the other hand, if a* is a random element of S[n, A^] with uniform distribution then, for 
fixed X = (xi,.. .,xn) G and y = (yi, ...,yn)^ S"-, 

^n,xi.y} P\.X(j* (1) yi, ... , Xg-* Un }) 

which is zero unless yi G {xi,..., x^}, that is when Sy < Sx, in which case 


P{Xo-*(i) yi, . . . , Un} 

and this agrees with u^,y{y} when v = Sx. 


0a(^3;{®})£j,{a} 

Wn ^ 


□ 
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We summarize some properties of the operator below. We denote by H^H the sup- 
norm of a real-valued function g ■. 

Lemma 3.2. Let 5 : S'” ^ M 6 e a function, as in (8), and f : —>• M a symmetric 

-measurable function. Then 

(i) l|t'„^9ll < llsll. 

(ii) (7”s = f/”>■!/”“, ifn, < »2 < ns. 

(Hi) II 17^(711 decreases as N increases. 

(iv) The function f is also measurable with respect to the a-algebra generated by {U(^h} 
where h ranges over all measurable function from S” into M. 

Proof, (i) Immediate from the definition. 

(ii) It follows from the fact that is the image of the uniform measure on S^(zz) under 

the projection —>■ S”. 

(iii) It follows from (i) and (ii). 

(iv) It suffices to show this for g{xi,... ,xn) = l_B(a;i) • • • ls(a;Ar)) where B € 5^. Let 

/ = C/^lsn. Then g' = 1 if and only if / = 1. Hence 5 is a measurable function of /. □ 

If we take a measurable function <7 : S” —)• M whose symmetrization U^g is identically 
zero then, clearly, g{Xi ,..., Xn) = 0, a.s., if W = {Xi ,..., Xn) has exchangeable law. Now 
suppose N > n and assume g{xi,... ,xn) is the identically zero function. Again, the 
conclusion that g{Xi,... ,X„) = 0, a.s., holds true. This is the content of the next lemma. 

Lemma 3.3. Let <7 : S” —>■ M 6 e a measurable function such that, for some N > n, 

U^g{xi,.. .,xn) = 0 , for all (xi,.. .,xn) G S^. 

Then, if X = (Ai,..., A„) is an exchangeable random element of S'^, we have 

g(^Xi,..., Xn) — 0 , a.s. 

Proof. Since g{x) is obtained by integrating g with respect to the measure the 

assumption that 9 is identically equal to zero implies, due to Lemma 3.1, that 



0 , for all V G 


By Lemma 2.1 this implies that 



0 , for all /r € .Xn{S). 


Let x = (xi ,..., Xn)- Set /i = in the last display and use again Lemma 3.1 to obtain 


Un x9 = 0) ^ii X € S'”. 

Suppose now that X = (Ai,..., A„) has exchangeable law. Then 

g{X) Ulx9 = 0, 

and so g{X) = 0, a.s. □ 
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3.2 The primitive extending functional. We come now to the definition of the 
main object of the paper. Given an n-exchangeable X = {Xi,... ,Xn), and N > n, the 
result of Lemma 3.3 tells us that the assignment 

:Uj:^g^Eg{Xi,...,Xn), (9) 


for (7 : 5” —>■ M bounded measurable, is a well-defined function. Indeed, if g = U^h then 
{g — h) = 0 and so, by Lemma 3.3, Eg{X) = Eh{X). Let 6(5'") be the Banach space of 
bounded measurable real-valued functions 5 : 5" —>■ M equipped with the sup norm. We call 
£^ primitive extending functional. The norm of induced by the sup norm on 6(5") is 


11 ^^ 11 = sup 

geb{S’-),g^0 


\Eg{Xi,...,Xn)\ 

\\u^g\\ 


( 10 ) 


Lemma 3.4. £j^ is a bounded linear map from {b{S^)) into M with norm at least 1. 

Proof. Linearity is immediate. Boundedness of £^ is tantamount to the existence of iL < 00 
such that |E( 7 (X)| < for all bounded measurable : 5" —>■ M. By exchangeability 

and Lemma 3.1 we have 


Eg{X) = EU:fg{X) = E 



g du. 


n,ex' 


By Lemma 2.1, 


/ 9 dul 


^c{ix,v) / gdu^ 





< \\Un9\\ 

u 


The reason for the latter inequality is that 


sup 

/ 9 du^ 

= sup 

[ 9dU^^, 

= sup \U^g{x)\ = \\U^g\\ 

v^jrNis) 

Js^ 


Js^ 



Therefore, |E( 7 (X)| <EY^^\c{ex,b')\\\U^g\\ < iL ||t/,^( 7 || with iL in (7). To see that ||5,(^|| > 
1 , quite simply notice that for ^(xi,..., Xn) = 1 the ratio inside the supremum in ( 10 ) equals 

1 . □ 


That extendibility is captured by £j^ is a consequence of the following two simple lemmas. 
The first is a straightforward rewriting of the definition of extendibility [31, Prop. 1.4]. 

Lemma 3.5. Fix N > n. An exchangeable random element X = (Xi,...,X„) of is 
N-extendible if and only if there is an exchangeable probability measure Q on such that 

Eg{Xi,...,Xn)= [ {U^g)dQ, ( 11 ) 

Js^ 

for all bounded measurable 5 : 5" —>■ R. 

Proof, X = {Xi,..., Xn) is Wextendible there is exchangeable random element Y = 

(Yi,...,yAr) of 5^ such that (Xi,...,X„) = (li,...,y„) = (y;(i),..., !(,(„)) for all a € 
&[n, A^]. Therefore (11) holds with Q the law of T. Conversely, if (11) holds, let (li,..., Yx) 
be a random element of with law Q. Since Q is exchangeable, the right-hand side of 
(11) is equal to Eg'(yi,..., Yn). Hence Eg{Xi ,..., Xn) = EgiYi ,..., Yn) for all bounded 
measurable <7 : 5" —)• R and this means that X is Wextendible. □ 
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The second lemma is a necessary condition for extendibility in terms of the norm of S^: 

Lemma 3.6. If the exchangeable random element X = {Xi,... ,Xn) of S'^ is N-extendible 
then ||T^|| = 1, where is the functional defined by (9). 

Proof. Assnming A^-extendibility, by Lemma 3.5 there is an exchangeable probability mea¬ 
sure Q on such that (11) holds. Then 


\EgiX)\ = 


I ( 


{U^g)dQ 




for all bounded measurable 5 : S’"" ^ M. Thus \£n f\ < ll/ll for all / in the domain of . 
So ||T^|| < 1. Since ||T^|| > 1, we actually have equality. □ 


3.3 Extending fnnctionals and their properties. Throughout, n,N are fixed 
positive integers, n < N, and X = (Xi,... ,X„) is an exchangeable random element of S"'. 
The primitive extending functional of (9) depends on n, N and the law of (Xi,..., X„). As 
N and n are for now kept fixed we denote £j^ simply by £. We pass on to a more general 
object than £. 

An operator defined on b{S^) is called symmetric if, whenever cj is a permutation of 
{1,... , X} and / G b{S^), its value at af does not depend on a, where af{xi ,..., xat) = 
f (®fT(l)) • • • ) 

Definition 3.7. We call extending functional any symmetric linear functional C : b{S^) —>■ 
M agreeing with £ on the domain of the latter and such that ||T|| = ||T||. 

We shall need the following simple lemma. When E is a linear subspace of b{S^) and 
f € V we write \\f\\v = sup^-g^jv \fix) \ and if T : E —M, we write ||T||y = sup||j||^<;^ IA/)I- 

Lemma 3.8. Let V be a linear subspace of b{S^) containing constant functions and L : 
E —>■ M a linear functional such that C{1) = 1 and \\C\\v = 1- Then C, is monotone: If 
f,g^V,f<g pointwise, then Cf < Cg. 

Proof. It suffices to show that if / > 0, / G E then Cf > 0. For such an / let h := ||/||y —/. 
ThenTh = ||/||v£(l)-£/ = ||/||y-£/. But \Ch\ < ||£||y ||h||y = \\h\\v, and \\h\\v < \\f\\v 
because both / and h are nonnegative. Hence ||/||y — Cf < \\f\\v and so Cf >0. □ 

Some properties are summarized below. Note that when / : —)• M and t G M then 

lf<t stands for the function on that is 1 on the set {x G : f{x) < t} and 0 on its 
complement. 

Lemma 3.9. (i) Extending functionals exist and any extending functional C satisfies 

C{1) = 1; 

(a) i/ ||T|| = 1 then C is monotone. 

(Hi) i/ ||T|| = 1 and f a function such that f{x)<l for all x G then 

. 1 -^/ 
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Proof, (i) Since the domain U^b{S'^) is a linear subspace of the Banach space b{S^), it 
follows from the Hahn-Banach theorem [14, Theorem 6.1.4] that there is S : b{S^) —>■ 
M extending £ and such that ||£^|| = ||T||. To produce a symmetric functional from this 
extension, set 

£ := £oU^. 

Since £ is an extension of £ we have ||£|| > ||£^||. On the other hand, ||£|| < ll^ll = 

||£|| = IjTIj. Hence ||£|| = ||£’||. Arguing as in the last step of the proof of Lemma 3.6, we 
have IgN = and so, from the definition of £, we have £{Uj^ls^) = lEls"(Ai) = 1. 

Since £ extends £, we indeed have £(1) = 1. 

(ii) Lemma 3.8 applies. 

(iii) Suppose /(xi,..., xat) < 1 for all (xi,... ,xn) € . Then 




and so 

£(/) + (1 - t)£(l/<t) = £(/ + (1 - t)l/<t) < 1 . 

□ 

The key to constructing an A^-extension of (Ai,..., A„) are the properties of the set 
function 

Fc{A) := C{1 a), 

particularly on measurable rectangles. A measurable rectangle is a subset of of the form 
Hi X • • • X B]\f, with Hi,... ,Big € 5^. The reason we insist on rectangles is because of 
symmetrization operations. This will become clear in the proof of Theorem 1.2, in Section 
3.4. For now we show the following. 

Lemma 3.10. Let X = (Ai,..., A„) be an exchangeable random element of S^. If C is an 
extending functional such that ||£|| = 1 and Fc is countably additive on the algebra generated 
by measurable rectangles of then there exists a unique exchangeable probability measure 
Q on such that Q{A) = Fc{A) for measurable rectangles A C and such that Q is an 
N-extension of the law of X. 

Remark 1. Before proving this, we point out that even under the condition that ||£|| = 1 
(which will turn out to be sufficient for extendibility), the function Fc{-) need not be a 
measure. What the last lemma says is that there is a probability measure Q agreeing with 
Fc on the algebra of rectangles but that Q{A) is not necessarily equal to Fc{A) for arbitrary 
measurable A C . We refer to §A.2 for an example. 

Proof of Lemma 3.10. By linearity of £, Fc is finitely additive. By (ii) of Lemma 3.9, 
Fc{A) > 0. By the countable additivity assumption on the algebra of rectangles and 
Caratheodory’s extension theorem, there is a probability measure Q on agreeing with 
Fc on rectangles. Since £ is a symmetric functional, we have that Fc{(y~^A) = Fc{A), 
where a~^A = {(Xo-(i),..., Xo-( 7 v)) ■ (^^i,... ,xn) S A}, and a a permutation of {1,..., A}. 
Hence Q is an exchangeable probability measure on . We show that Q is an extension 
of the law of A = (Ai,..., A„) by showing that (11) holds. It suffices to show that it holds 
for g = La with A C S'" is a rectangle, i.e., A = Ai x ■ ■ ■ x A„, with Aj S But then 
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a ^Ac. is in the algebra of measurable rectangles of . Starting from the right-hand 
side of (11) we have 




(7£&[n,N] ' 


(N) 

(a) 1 


k- E 


crG&[n,N] 


iN)r 




= L 


(Tg6[n,Af] 
1 


{^)r 




E 


o-G6[n,Af] 


= P(X e A), 


where (a) is because Q agrees with on the algebra of measurable rectangles of , (b) 
because £ agrees with £ on the domain of £ and (c) by the definition (9) of £. □ 


3.4 A criterion for finite extendibility. Up to now, we kept the space S as general 
as possible. We shall now need to introduce some topological assumptions on S and some 
assumptions on the given probability measure. 

We assume that S' is a locally compact Hausdorff space. Then is the class of its Borel 
sets, the smallest cr-algebra containing open sets. A probability measure P on S is tight 
if for all e > 0 there is a compact set K such that P{K) > 1 — e. A measure P is outer 
regular^ if for all A E P{A) = inf P{0) where the inhmum is taken over all open sets 
Od A. 


Lemma 3.11. Suppose that S is a locally compact Hausdorff topological space and X = 
{Xi,..., Xn) an exchangeable random element of such that the law of Xi is tight. Fix 
N > n. If C is an N-extending functional with norm 1 then the restriction of C on the 
space Cc{S^) of continuous functions with compact support has norm 1 also. 

Proof. Let 0 < e < 1/n. By tightness, there is a compact set K C S such that P(Ai € 
K)>l-s. Hence P((A:i, ..., A„) E A") > 1 - ne. Let 

g(^Xi, ... , Xn} ■ — liC"( 3^1 ) • • • ) Xn). 


It is easy to see that 


Apply (hi) of Lemma 3.9 to / 


t := sup g{x) < 1. 


u^g-- 


^{^uF9<t) E 


1 - t 


^ For probability measures, outer regularity and tightness are equivalent to regularity (i.e., inner regularity 
and outer regularity). But we use the former terminology throughout the paper, since we will use explicitly 
outer regularity and tightness in the proofs. 
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But 


while 

C{U^^g) = £{U^g) = ¥.g{X) = P(X G K") > 1 - ne 

and so 

C{±kn) > 1 - 

By Urysohn’s lemma [27, p. 39], there exists a function F G Cc{S^) such that 0 < F < 1 
everywhere and F = 1 on . Hence l^^iv < F. By the monotonicity of F, 

77 p 

F(F)>F(1;^.)>1-^. 

Since e is an arbitrary positive number this says that F(F) > 1 implying that the norm of 
F restricted to Cc{S^) is at least 1. On the other hand, the norm of the restriction cannot 
be larger than the norm of F which is 1. Hence the norm of the restriction is equal to 1. □ 

We now pass on to the proof of the main theorem. 

Proof of Theorem 1.2. By Lemma 3.11, the norm of the restriction of F on Cc{S^) is 1. By 
the Riesz representation theorem [27, p. 40] there is a measure Q on such that 

Cf= f fdQ, feC.iS^). 

Js^ 

By (i) and (ii) Lemma 3.9, we have that Q is a probability measure. Moreover, the Riesz 
representation theorem guarantees that 

Q{G) = sup{F/ : / G Cc{S^), 0 < / < 1, supp(/) C G}, open G C , (12) 

where supp(/) = {x : f{x) 0}. We shall prove that Q provides the announced N- 
extension. Fix a measurable rectangle 


F = Hi X • • • X Hat, 

and 0 < e < 1/A^^. By the outer regularity of the law of Xi, pick open sets C S such 
that 

Aj C Aj^i;, P(Xi G Aj) < P(Xi G < P(Xi G Aj) + e, 1 < J < IV. (13) 

Then 

R c Hi £ X • • • X Hiv g =: 

and so 

Gi; := Os \ R = {x € : Xj G Aj^s \ Aj for some 1 < j < N} (14) 

Consider also the subset of S'” dehned by 


Fs := {(xi,..., Xn) ^ : Xi & Aj^s \ Aj for some l<i<n, l<j< N} 

and, with Ff = S'^XFs, let 

#{cr G 6[n,N] : x^r^i) 0 Aj^s\Aj, Mi <n,j < N} 


f{xi,...,XN) ■= {UJ^1 fA{xi,...,xn) = 
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If a; € Gg then Xj G Aj^^\Aj for some j < N. Then the number of injections a : {1 ,... ,n} ^ 
A^} such that 0 Aj^^ \ for alH = 1,..., n is at most the number of injections 
from {1,..., n} into {1,..., A^} \ {j}, that is, at most {N — 1)„. Therefore, 

GeC{xeS^ : fix) <iN - n)/N}. 

By the monotonicity of C, 

^i^Ge) < ^{^f<{N-n)/N)- 

We now apply (iii) of Lemma 3.9 to /, with t = (N — n)/N: 

r,, ,, 1-A/) 

£(1/<(a.-„)/n) < 1_(JV_„)/JV 

But 


£(/) = li.c) = SiUj^lF^c) = Elf^c(Wi,..., X„) = P((Xi,..., X„) 0 F,) 

n N 

£i-EE P(W G Aj^^ \ Aj) > 1 — nNe, 

i=i j=i 

where the last inequality is due to (13). Combining the above, we have 

CilGj<Nh. 

Using (14) and the monotonicity of T, we have 

£(loJ - £(!/?) = ^(lo.w) = ^(IgJ < N‘^£- 

On the other hand, by (12) and the monotonicity of C, 

Q(0,)<£(loJ. 

From the last two displays we have 

QiR) < Q{Oe) < C{±r) + N^e. 


Letting e j, 0 we obtain 

QiR) < Ciln). 

This is true for all measurable rectangles R and, by additivity, true for all sets in the algebra 
of rectangles. Hence true for \ R. This implies that we actually have equality; 

CiiA) = QiA), 

for all A in the algebra of measurable rectangles of . Since Q is a measure, the assumptions 
of Lemma 3.10 hold and so Q is an A^-extension of the law of (Aii,..., Xn)- □ 

Corollary 3.12. Given an n-exchangeable probability measure Pn on S'” and N > n, such 
that one-dimensional marginal of Pn is tight and outer regular and S a locally compact 
Hausdorff space, we can formulate the criterion for N-extendibility as follows: 


Ve > 0 G ‘hn 3ai, ..., on G S such that 
1 + e 


/ 

Js^ 


gix) Pnidx) 


< 


iN)r 




r(l), 


) ®(T(n)) 


where the sum is taken over all injections u : [n] —>■ [A^]. 


(15) 
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Indeed, this says that \\£n\\ < 1 and, since ||£’^|| > 1 always, it expresses precisely the 
condition of Theorem 1.2. 

Remark 2. In the proof of Theorem 1.2 we actually showed that, under the stated condi¬ 
tions, for any A^-extending functional £ : —>■ M there is a probability measure Q on 

such that CXa = Q(^) for A in the algebra of measurable rectangles of . 

4 FROM FINITE TO INFINITE EXTENDIBILITY 

We are seeking conditions that enable us to extend an n-exchangeable probability measure 
to an exchangeable probability measure on in the standard sense. It seems natural to 
posit that X is Wextendible for all X > n if and only if X is extendible to One direction 
is clear: If X is an exchangeable random element of then {Xi, ..., X^) is X-exchangeable 
for all X G N. But the other direction is not a priori obvious since we may have an N'- 
extension and an ^''-extension of X, for some n < N' < N", but the ^''-extension may 
not be an extension of the X'-extension. Even worse, the X'-extension might not be further 
extendible. 

One may attempt to use Prohorov’s theorem to prove the infinite extendibility by obtain¬ 
ing an appropriate infinite exchangeable sequence. This is possible in a metric space. But 
we work with a locally compact Hausdorff space (not necessarily metrizable). Eor a locally 
compact Hausdorff space there is a version of Prohorov’s theorem [2] whose conclusion is 
stated in terms of continuous functions with compact support. This class of functions is 
not big enough for our purposes. Indeed, as in Lemma 3.5 the set of test functions required 
for Y-extendibility is U^g, where g ranges over bounded measurable functions on 5”, and 
these functions are merely bounded. To bypass this difficulty, we will rely on a functional 
analytic approach (and use the Hahn-Banach theorem again) in the theorem below. 

Theorem 4.1. Let n be a positive integer, n >2. Assume that the hypotheses in Theorem 
1.2 hold. The following are equivalent: 

(a) X is N-extendible for all N > n. 

(b) There is a random element Y = (Yi,y 2 )---) of with exchangeable law such that 
(Xi,...,Xn)^^ {Yi,...,Yn). 

Proof. Only (a) (b) needs to be shown. For fc G N, let = b{S^) be the set of bounded 

measurable functions on equipped with the sup norm. Let be the set of all bounded 
measurable real-valued functions f{xi,... ,xn) on for some N > n: 

:= U 

N>n 


k < i then <I>fc is naturally embedded into if / G then we can define / G 
by /(xi,..., Xk, • • •, xf) := /(xi,..., Xfc). We shall write C for this embedding; this 
should be read in the sense that the image of under / i—)• / is contained in <!>£. If / G ‘h* 
then there is a A: > n such that / G The Wsymmetrized version of / is as in 

(8). Since C for k < i, we can also consider f for k < £ < N. We can easily see 

U^f = u^f- 

We let if he the minimum N such that / G We next define a relation ~ on by 
/~9 Ul^^f = Ul^g, f,ge^*,N>max{if,ig}. 
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We see that ~ is an equivalence relation. To check transitivity, suppose f ^ g and g ^ h. 
Then = U^^g and U^g = U^h for some M and N. Letting L := max(M, A^) and 

using the property (ii) of Lemma 3.2 we have = U^^^g and Ul'^g = Ul"^h, implying that 
f ^ h. In particular, notice that any / € <I>* is equivalent to some symmetric function 
because 

/ ~ C/f/, for all IV > A; > i/. (16) 

From the discussion above and property (ii) of Lemma 3.2 we also see that 

/ ~ <7 3/co so that \i < k < N then f = g. (17) 

Let [/] be the equivalence class of /; 

[/] ■.= {gG^* : gr-^ /}, 

and let [$*] be the collection of equivalence classes: 

m :={[/]: 

We can easily check using (17) that if / ~ /' and g ^ g' then, for all a, /3 G M, a/ + /3g ~ 
af + f3g'. Hence we can define 

a[/] + Pig] ■= [o^f + Pg], 

which means that [$*] is a linear space with origin [0], the set of functions equivalent to 
the identically zero function. 

By Lemma 3.2(iii), the norm ||L)^g'|| decreases as N increases, so we attempt to define a 
norm on [$*] by 

IIMil := lim \\U,^g\\ = inf \\Ul^g\\. 

First, it is clear that if <7 ~ /i then ||M|| = ||[/i]||; so [g] i-)- HMH is a well-defined function. 
To see that the triangle inequality holds we use (16) and (17). Let 51,52 G ‘h*. Then we 
can choose k so that for 51 ~ gi and 52 ~ g 2 , for all large N. Then 51 -|- 52 ~ 

= Ukioi + 92 ) and so 

I|[ 5 i+ 52 ]|| = inf ||t/f (51-h 52)11 

N>k 

< inf (||[/f5i|| + rfc%ll) 

N>k 

= hm {\\ui^gi\\ + \\ui^gi\\) = 

N^ca 

To check positive definiteness we prove the following: 

Lemma 4.2. // 5 G <1>* has ||[ 5 ]|| = 0 and if f G is 
f ^ g then f is identically zero. 

Proof. Let / G be a symmetric function and vr a probability measure on (S,^). Then 

{[/«+«/) 

J5JV Js^+M 

So then ||7r^(/)|| < f\\. Note that limM^oo ||t7j!^'^^/|| = ||[/]||- Let g e have 

II [ 5 ] II = 0 and assume f ^ g. Then ||[/]|| = ||[ 5 ]|| = 0. Hence 

7r^(/) = 0, for any probability measure vr. 


IIM]|| + IIMI|. 

a symmetric function such that 
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By (2) 


]E[/(y)] = 0, for any A^—exchangeable Y = (Yi,..., Yn). 

Together with the symmetry of /, this implies that / is identically 0. □ 

Suppose now that ||[ 5 ']|| = 0. Then g ~ U^g for some k and N. By Lemma 4.2, U^g 
is identically zero. Thus [g] = [0]. We have thus shown that [$*] is a normed linear space. 
Consider now 

i^n] ■■= {[/] : / e $n}. 

Clearly, is a linear subspace of [4>*]. It is normed by the same norm. We now attempt 
to define a linear functional 

: [$„] ^ M 

based on the following observation. If /,5 € have Ef(Xi,... ,Xn) / IE 5 (Xi,... ,Xn) 
Then, by Lemma 3.3, 11^1 / U^g for all N >n. So then f g and so [/] / [ 5 ]. Therefore, 

:[g]^Eg{Xi,...,Xn) (18) 


is a function; in fact, a linear function from [<I>„] into M. Consider the norm of C^: 


,^0n l^°([9])l \Eg{X,,...,X^)\ 

K II = sup = sup sup- u77Wl\ -= 11 “^^ 

II Mil gG<S>nN>n IMn ffll N>n 


Wii 
n In 


where the last equality is due to (10). Since, by assumption, (Xi,..., Xn) is ^-exchangeable 
for all N > n, we have (Lemma 3.6) that ||T,^|| = 1 for all Y > re and so 

||£»|| = L 


The Hahn-Banach theorem guarantees that there is a linear functional 


C* : [$*] ^ M 

such that C* = on [‘hn] and 

\\c*\\ = ||/: 0 || ^ I 

We then define 

Cg := C*{[g]). (19) 

Note that £ is a linear functional which is moreover symmetric, that is, Cg = Cg' if g' is 
obtained from g by permuting its arguments. Since ||£*|| = 1, we have, for all € $*, 

|r9l = |£*(bl)l<llblll = inf||<9ll<ll9ll. 

IS ^ 


and so 

ll^ll = 1 - 


In particular, for Y > re, let 

c^ ■— c\ 

( 20 ) 

the restriction of C onto Then 

IIT^II = 1 

ll-^n 11 

( 21 ) 

We now claim that C^ is an Wextending functional, that is. 


nN 

= S^ onf/„^cI.„. 

( 22 ) 
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To see this, let / = U^g for some g £ Then f = 'E,g{Xi,... ,X„). On the other 
hand, 

CiU^^g) C*{[U^g]) = C*{[g]) = ¥.g{X^,.. .^X^). 

Note that the symmetry of is inherited from C. Therefore CJ^ is an A^-extending func¬ 
tional of (Xi,..., Xr^. 

Since was constructed via the operator £, we have the consistency property: 

= n<N<N', (23) 

for all A in the algebra of measurable rectangles of . As in the proof of Theorem 1.2 (see 
Remark 2), we have that there is a probability measure, say , on , such that 

for all A in the algebra of measurable rectangles of . So (23) implies that 

Q^iA)=Q^\AxS^'-^), n<N<N', 

for all A in the algebra of measurable rectangles of . Moreover, 

F{Xu...,Xn£A) = Q^{AxS^-^), 

for all A € and all N >n. By Kolmogorov’s extension theorem [26, p. 82], there exists 
a probability measure Q on (5^,o5^^) such that Q(A x S°°) = (A) if A € for all 

N > n. By the A^-exchangeability of Qn , for all N, we have that Q is an exchangeable 
probability measure on (S^,A^^). Let Y = (Li,y 2 j---) be a random element of 5^ with 

law Q. Then (Xi,..., Xn) (Li, • • •, Yn). This completes the proof. □ 

5 A REPRESENTATION RESULT FOR FINITE EXCHANGEABILITY 

It is natural to ask under what conditions can the representation formula (2) for an n- 
exchangeable probability measure hold with u a probability measure. We give a criterion in 
terms of a functional defined below that uses the notions and the theorem developed in this 
paper. 

Let X = {Xi,..., Xn) have exchangeable law in 5". For g : ^ M. bounded and 

measurable and vr a probability measure on S let 

I{g,Tr) := g{xi,... ,Xn)T^{dxi) ■ ■ ■-K{dxn)- (24) 

Js^ 

Clearly, g i—>• I{g,Tr) is linear. Let 

11 ^( 9 , Oil— sup \I{g,Tr)\, 

n€L^{S) 

which, for g bounded and measurable, is finite since 11/(5,011 < Ibll- A simple consequence 
of (2) is that if I{g, vr) = I{h, ir) for all tt G ^{S) then 'Kg{Xi, ..., Xn) = E/i(Ai, ... , Xn)- 
Hence the assignment 

r :/(5,0 ^%(^l,---,^n) 
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is a function from the linear space {I{g,-), g G 6(5”)} into ffi. Clearly, it is linear; it is also 
bounded because 


|Eg(Xi,...,X„)| 



I{g,TT)u{dTT) 


<ll/(5,-)ll 11^^ 


where 

\\u\\ = + i'~{S), 

which is finite by Theorem 1.1. So, the norm ||T|| of T satisfies 


1 < iini = sup 

9 


|Eg(Xi,...,X„)| 
11 ^( 5 , 011 


< ||z^|| < oo. 


(25) 


the inequality being true for any signed measure v satisfying (2). That ||T|| > 1 is clear 
from the choice <7 = 1. In the sequel, we will assume that 5 is a locally compact Hausdorff 
space. The Baire u-algebra of S is the cr-algebra generated by the class Cc{S) of continuous 
functions / : 5 —>■ M with compact support. This, as in Hewitt and Savage [18], will 
guarantee that de Finetti’s theorem holds. Other conditions are, of course possible. For 
example, assuming that 5 is a locally compact Polish space will also work. 

Theorem 5.1. Let X = (Xi,... ,Xn) he an exchangeable random element of S^. Suppose 
that the hypotheses of Theorem 1.2 hold. In addition, assume that IX is the Baire a-algebra. 
Then the following three assertions are equivalent: 


1. X is N-extendible for all N > n (or, equivalently, by Theorem 4-1, X is infinitely 
extendible) 

2 . lini = 1; 

3. there exists a probability measure v on lX{S) satisfying (2). 

Proof. 1 3: If X = (Xi,..., X„) is X-extendible for all X > n there is, by Theorem 4.1, 

an exchangeable random sequence Y = (Yi, T 2 , ■ ■ ■) such that (Xi,..., Xn) (Yi,..., Y^). 
Since X' is the Baire cr-algebra, Theorem 7.4 of Hewitt and Savage [18] applies: there exists 
a probability measure u on £X{S) such that: 

P(Y £ A) = [ 7r°°(H) v{d7r), A G 

J^{S) 

and hence 

P(X GB)= [ 7r”(H) z/(d7r), B G 

3 => 2: Since the last display holds with u a probability measure, (25) gives 1 < ]|T|| < 
2^1: Let N > n. Using symmetry, (24) gives 


Hence 


I{g,TT)= / {U(^g){xi,... ,XN)Tridxi) ■ ■ - TridxN)- 

Js^ 


||I(5,-)|| < sup \{U^g){x)\ = \\U(;^g 
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By (25), and (10) 


1 

Since |£’,^|| > 1, we have \\8^ 

Ai-extendible. 

6 ADDITIONAL RESULTS AND COMMENTS 

6.1 A different version of Theorem 1.2. Theorem 1.2 proved in this paper states 
that, under suitable assumptions, an exchangeable random element (Ai,..., A„) of jS” is 
A-extendible if and only if sup^ |Eg(A)|/||? 7 ,^ 5 || = 1 , where the supremum is taken over 
all bounded measurable functions g : S'” —>• M. We wish to see whether the supremum can 
be reduced to a smaller class of functions. For example, suppose that is an algebra 
generating the Borel sets of S. Replacing the tightness and outer regularity assumptions 
by assumptions that involve the class allows us to consider the supremum over the class of 
sets that are linear combinations of of indicators Xv^x—xVn with Vi € The assumptions 
imposed by the next theorem are satisfied in all natural cases. The proof follows closely the 
proof of Theorem 1.2 and thus is only sketched. 

Theorem 6.1. Let he an algebra of subsets of the locally compact Hausdorff space 
S generating its Borel sets. Let {Xi, ..., Xn) be an exchangeable random element of S^. 
Assume: 

(a) For all e > 0 there exists V £ and compact set K such that V V K and P(Xi € 
U) > 1 - e. 

(b) For all £ > 0 and all V G AXq there exists open set O and W G such that U C O C IT 
and P(Xi £W\V)<£. 

Then, for N > n, (Xi,..., Xn) is N -extendible if and only if 

sup|E 5 (X)|/|| 17 ,^ 5 ll = l, (26) 

g 

where g in the supremum ranges over the set of all linear combinations of indicators lvix---xv,i 
with Vi £ =5^0- 

Sketch of proof. We only need to prove sufficiency. Denote by 5 the class of functions that 
are linear combinations of indicators lvix---xv„ with Vi £ 5^^. Assume that the supremum 
in (26), over the class ^ of ( 7 ’s equals 1. This assumption is equivalent to having the norm of 
En on ^ equal to 1. As in Lemma 3.9(i), we can extend this restriction to the set b{S^) of all 
bounded measurable functions on , using the Hahn-Banach theorem, without increasing 
its norm. We can also assume that the extension is a symmetric operator. Denote it by C. 
Since C{\) = 1 and ||T|| = 1 we have, as in Lemma 3.9(ii) that £ is monotone and hence 
£(1a) > 0 for all Borel A C . Using (a), and arguing precisely as in Lemma 3.11, we 
obtain that C has norm 1 on Cc{S^). We then proceed as in the proof of Theorem 1.2 
to extract, via Riesz representation, a probability measure Q on that satisfies (12) and 
which is also symmetric. It then suffices to show that if R = Ui x • • • x Rv is a rectangle 
with Vi £ EXq, we have Q{R) < £( 1 _r). Let e > 0. Using (b) we select and 

open sets such that V) C Oi,g C Wj^g and P(lUj^g \ V)) < e. This is used to prove that 
Gg := (lUi^g X • • • X lUv^g) \ R satisfies 

£(1gJ < N\. 


Il'TII ^ 


= \\£, 


N\ 


= 1. By Theorem 1.2 we conclude that (Xi,...,X„) 


□ 
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Since := Oi,£ x • • • x OM,e is an open set containing R we have 

Q{R) < Q{Oe) < C{Yo,) < C{Yr) + Nh, 

where we used (12) for the second inequality and the previous display for the last. Letting 
£ 4 - 0 , we conclude. □ 

Remark 3. Property (a) of Theorem 6.1 clearly implies tightness. Using the monotone 
class theorem, we can also show that property (b) implies outer regularity. On the other 
hand, the assumptions of Theorem 1.2 do imply those of Theorem 6.1 provided that the 
algebra and the space S are suitable; for example, with S = M. and the algebra 
generated by intervals. 

6.2 Extendibility under limits. First, we observe that extendibility is a property 
that remains true under limits in total variation. Assume that S' is a locally compact 
Hausdorff space. Let A* = (A|,...,A^), i = 1,2,..., be a sequence of exchangeable 
random elements that are A-extendible such that A* converges to A = (Ai,...,A„) in 
total variation. Assume that the law of X\ is tight and outer regular. Then A is N- 
extendible. Indeed, A is clearly exchangeable, but that it is A-extendible: By the total 
variation convergence we have 

lim E 5 (A*) = Eg{X) 

i^oo 

for all bounded measurable 5 : S”' —>■ M. If is the primitive extending functional of A 
then, by (10), we have ||S,^|| < 1. The claim follows from Theorem 1.2. 

On the other hand, we have the following result that, roughly speaking, says that if we 
have extendible probability measures on coarse cr-algebras whose union generates the full 
cj-algebra in a way that Pk converges to P in a certain sense, then P is extendible: 

Theorem 6.2. Let LXq he an algebra of subsets of S generating LX, Let all assumptions of 
Theorem 6.1 hold. In addition, suppose that there is an increasing family C 1^2 C • • • of 
a-algebras on S such that = =^o- For each k, let Pk be a probability measure on 

defined on (the product a-algebra) such that 

lim sup \Pk{A) — P{A)\ = 0, (27) 

fc-fOO 

where P is the law of (Ai,..., A„) and assume that, for some N > n, and all k > 1, Pk is 
N-extendible. Then P is N-extendible. 

Proof. Let g a the class of real-valued functions on that are linear combination of 
indicators lvix---xVn with V) G LXq for all i. Then there is k such that g is l^fc-measurable. 
Our assumption then implies that gdPk —> fgn gdP as A: —>■ 00 . We now appeal to 
Theorem 6.1. Since Pk is A-extendible, we have sup^g^ | / = 1- Hence 

supggj I f 5 ((iP|/||C/,^g(|| = 1 also and so, by Theorem 6.1, P is A-extendible. □ 

We give an example of how this can be applied using a known example of an extendible 
distribution. Gnedin [17] shows that if (Ai,..., A„) is a random element of M” with density 
f(xi ,..., Xn) = g(xi V • • • V Xn) for some decreasing g then it is infinitely extendible. We will 
provide an alternative proof for this by constructing, for each j G N, an infinitely-extendible 
probability measure Pj on some coarse cr-algebra .Xj of S'”, increasing with j, such that 
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Pj approaches the law of (Xi,... ,Xn) in the sense of (27). Without loss of generality, let 
n = 2. 

Fix j G N. Let be the set of rational numbers /c/2-^ for k = 1,... ,j2P This splits 
the positive real line into a finite number of intervals: the bounded intervals Ik{j) ■= 
[{k — 1)2“-^, k2~^) and the interval Io{j) ■= [j, oo). We let = cr(nj) and = [jj It is 
easy to see that (a) and (b) of Theorem 6.1 hold for the algebra =5^o- Next, let 
the corresponding product cr-algebra on [0,oo) x [0, oo). To specify probability measure Pj 
on the sets of it is enough to specify it on the sets Ik{j) x We let 

PjilkU) X Ie{j)) = Cj g{{k V l)/2^), l<k,l< j2\ 

and set Pj{Ik{j) x [j, oo)) = Pj{[j, oo) x Ik{j)) = 0. The constant cj is just a normalization 
constant. By construction, Pj is exchangeable. We see that it is infinitely extendible by 
observing that it is a mixture of product measures. 

For 1 < r < j2^, define the product probability measure Qr on ^j by 

QrihU) X leU)) = ^, l<k,e< j2^, 

while Qr{Ik{j) X [i, oo)) = Qr{\j,oo) X Ik{j)) = 0. Then, with = r/2'^ for r < j2^ and 
0‘j2i+l = 0 ) 

= ^3 '^is{ar) - g{ar+i)]r‘^Qr, 

r=l 

and the coefficients are positive due to the monotonicity of g. 

We finally observe that, for all z G N, 


max 

l<k,e<i2i 


Pj{Ik{i) X h{i)) - g{xV y) dxdy 

JI 


0, as j —)■ oo, 


meaning that condition (27) of Theorem 6.2 is verihed. 


APPENDIX A. 

1) Covariance. Exchangeability imposes strong conditions on covariance for second-order 
random variables. That is, if {Xi,... ,X„) is n-exchangeable random element of R"" with 
EAf < oo then it is easy to see that cov(Ai, X 2 ) > — var(Ai)/(n—1). On the other hand, if 
(Ai, X 2 ,...) is an exchangeable sequence of real random variables with hnite variance then 
cov(Ai, A 2 ) > 0. However, if (Ai,..., A„) is n-exchangeable, nonnegativity of cov(Ai, A 2 ) 
is not at all sufficient for infinite extendibility. For example, take n = 2, S = {si, S 2 , S 3 , S 4 } = 
{1, 1.5, 2, 2.5} and let (Ai, A 2 ) take values (si, S 2 ), (s 2 , si), (S 3 , S 4 ), (S 4 , S 3 ) with probability 
1/4 each. Then cov(Ai,A 2 ) = 3/16 but it is easy to see that (2) cannot hold with n a 
probability measure. By Theorem 5.1 (Ai, A 2 ) is not inhnitely extendible. 

2) An example of an extending functional not defining a probability measure. 

We give an example of an extending functional £ such that A 1 —)• £(1a) is not a probability 
measure. See Remark 1. Let S = [0,1], the closed unit interval. Take n = 1 and N = 2 and 
start with the probability measure on [0,1] to be the uniform measure on the Borel sets 
Let <l>j be the set of bounded measurable real-valued functions on [0,1]*, z = 1, 2. 
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For 5 ^ G <I>i we have {U‘lg){xi,X 2 ) = \{g{xi) + g{x 2 ))■ The primitive extending functional 
£ maps UiQ to g{t)dt. 

We now construct a particular 2-extending functional £. We let 5^ consist of functions of 
the form 

m 

F{x,y) = '^Cil{x € Ai,y € Bi}, Xi eR, Ai, Bi e (28) 

i=0 

D := : 0<t<l} and let ^ consist of functions of the form 

G = F cl/), T G 5, c G M. 


Define the symmetric functional To • ^ M by 

To(T + c1d) := EF(X,X) = [ F{t,t)dt. (29) 

Jo 

We claim that ||To|| = 1- See below for the proof of this claim. Since 2) is a normed linear 
subspace of $2 there exists (by the Hahn-Banach theorem) a symmetric linear functional 
T : $2 ^ 1^ such that T = Tq on T* and ||T|| = ||To|| = 1- 

We show that T is a 2-extending functional, i.e., that C{Uig) = f^g(t)dt, for all g G 
<l>i. Let fn (respectively, hn) be an increasing (respectively, decreasing) sequence of simple 
functions on [0,1] (i.e., linear combinations of finitely many indicator functions of Borel 
subsets of [0,1]) such that /n t 5 (respectively, hn i g)- We have fn < g < hn for all n, 
and so Uifn < U^g < t/f/in- Since ||T|| = 1, by Lemma 3.8, T is a monotone operator. 
Hence T(f7f/„) < C{Ufg) < C{U‘lhn) for all n. Since U^fn G 5, we have C{U‘ifn) = 
J^oiUffn) = Jq fn{t)dt. Similarly, C{Uihn) = jQhn{t)dt. By monotone convergence, 
lim„^oo/oVn(i)dt = lim^^oo Jq hn{t) dt = ff(t) df. Therefore, C{Ufg) = Jq g{t) dt = 
£{Uig), showing that C is an extension of £. 

As in the proof of Theorem 1 . 2 , the functional L restricted on the space (^([0,1] x [0,1]) 
of continuous functions on [0,1] x [0,1] admits the Riesz representation 

CF = f F{x,y)Q{dx,dy), F G (^([0,1] x [0,1]), 

[0,1] X [0,1] 

for some probability measure Q on [0,1] x [0,1] and this Q is a 2-extension of the law of X. 
It is easy to see that Q is the law of {X, X). 

We have (as in the proof of Theorem 1.2) T(l/j) = Q{R) for all rectangles R = A x B, 
A,B £ 

If A I—)• T(1a) were a probability measure on the Borel sets A of [0,1] x [0,1] we would 
certainly have T(1a) = Q{A) for all Borel A C [0,1] x [0,1]. But T(1d) = To(lz)) = 0 in 
contradiction to Q{D) = P((A, W) £ D) = 1. 


Proof of the claim that Cq has norm 1. We need to show that |To(F-|-cl/))| < ||F-|-cl/)||, 
for all F G and all c G M. If c = 0, the inequality holds. If c / 0, divide by c and use (29) 
to reduce the claim to the proof of the inequality 



< max |F(x, y)\ V max |F(t, t) -|- 1 

x^y t 


F£iS- 


We consider two cases. If max^-^j^ |F(x,y)| = \F{x,y)\ then 


f F{t,t)dt\ 
Jo 


< max |F( 3 :, y)\ 
x,y 


max |F(a;, y)\ < max |F( 3 :, y)\ V max |F(t, t) -|- Ij. 

x^y x^y t 
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If not, there is to S [0,1] such that |F(to,to)| > niaxa;^^ \F(x,y)\. Since F can be written 
as in (28) with pairwise disjoint Ri, it follows that one of the Ri must be a singleton, say, 
Ro = {^o} X {^o}- Without loss of generality, assume that this is the only singleton among 
the Ri’s. Then F = col/jp + H, where H = YlTLi^i^Ri has the property of case 1, i.e., 
maXx^y\H{x,y)\ = max,,^y\H{x,y)\. Then 


1 C Fit t 

/7-/-I _ 1 

/ rl-f-l 

1 / 

40 

.jQjLi — 

j 11 CLl\ 

Jo 


< max \H{x, y)\ 
^,y 


m.ax\H{x,y)\ 

xjty 


max|F(x,y)| 

xjty 


< max|F(x,y)| V max|F(t,t) + 1 

xj^y t 


□ 
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